Search for: All records

There has been growing recognition of the crucial role users, especially those from marginalized groups, play in uncovering harmful algorithmic biases. However, it remains unclear how users’ identities and experiences might impact their rating of harmful biases. We present an online experiment (N=2,197) examining these factors: demographics, discrimination experiences, and social and technical knowledge. Participants were shown examples of image search results, including ones that previous literature has identified as biased against marginalized racial, gender, or sexual orientation groups. We found participants from marginalized gender or sexual orientation groups were more likely to rate the examples as more severely harmful. Belonging to marginalized races did not have a similar pattern. Additional factors affecting users’ ratings included discrimination experiences, and having friends or family belonging to marginalized demographics. A qualitative analysis offers insights into users' bias recognition, and why they see biases the way they do. We provide guidance for designing future methods to support effective user-driven auditing. 

Algorithmic systems help manage the governance of digital platforms featuring user-generated content, including how money is distributed to creators from the profits a platform earns from advertising on this content. However, creators producing content about disadvantaged populations have reported that these kinds of systems are biased, having associated their content with prohibited or unsafe content, leading to what creators believed were error-prone decisions to demonetize their videos. Motivated by these reports, we present the results of 20 interviews with YouTube creators and a content analysis of videos, tweets, and news about demonetization cases to understand YouTubers' perceptions of demonetization affecting videos featuring disadvantaged or vulnerable populations, as well as creator responses to demonetization, and what kinds of tools and infrastructure support they desired. We found creators had concerns about YouTube's algorithmic system stereotyping content featuring vulnerable demographics in harmful ways, for example by labeling it unsafe'' for children or families -- creators believed these demonetization errors led to a range of economic, social, and personal harms. To provide more context to these findings, we analyzed and report on the technique a few creators used to audit YouTube's algorithms to learn what could cause the demonetization of videos featuring LGBTQ people, culture and/or social issues. In response to the varying beliefs about the causes and harms of demonetization errors, we found our interviewees wanted more reliable information and statistics about demonetization cases and errors, more control over their content and advertising, and better economic security. 

The Negro Motorist Green Book was a tool used by the Black community to navigate systemic racism throughout the U.S. and around the world. Whether providing its users with safer roads to take or businesses that were welcoming to Black patrons, The Negro Motorist Green Book fostered pride and created a physical network of safe spaces within the Black community. Building a bridge between this artifact which served Black people for thirty years and the current moment, we explore Black Twitter as an online space where the Black community navigates identity, activism, racism, and more. Through interviews with people who engage with Black Twitter, we surface the benefits (such as community building, empowerment, and activism) and challenges (like dealing with racism, appropriation, and outsiders) on the platform, juxtaposing the Green Book as a historical artifact and Black Twitter as its contemporary counterpart. Equipped with these insights, we make suggestions including audience segmentation, privacy controls, and involving historically disenfranchised perspectives into the technological design process. These proposals have implications for the design of technologies that would serve Black communities by amplifying Black voices and bolstering work toward justice.